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ABSTRACT ; 

This is one of the outcomes of the work of, the 
Massachusetts Evaluation Service Center for Occupational Education 
(ESCOE). This publication is intended to serve primarily as a user's 
guide for facilitators and instructors associated with ESCOE who seek 
to use and implement the Synthesized Objective Package. Besides a 
short explanation of the Objective Synthesis Process, the instruction 
manual contains- replicas of feedback documents from ESCOE to the 
Local. Education Agencies (LEAs) , and from LEAs back to ESCOE, along 
with instructions on how to use and implement the various sections of 
the package. (A glossary of terms and phrases and a three-page 
bibliography are appended.) (Author) 
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PREFACE 



In "Learning for Mastery" Bloom (1968) posits: ^ . 

There is little question that the schools do pro- 
vide experience for some students--perhaps as high as 
one-third of the students. If the schools are to provide 
successful and satisfying learning experiences for at least 
90 per cent of the students, major changes fliust take 
place 1n the attitudes of students, teachers* and admin- 
istrators; changes must also take place in teaching stra- 
tegies and 1n the role of evaluation. 

Curriculum revision, new defclgns 1n teacher education, and other 
Innovative programs are evidence ^f the search to improve education. 
Inherent 1n these attempts is the assumption that the status of the educa- 
tion system 1s known and that its Inadequacies can be empirically Identi- 
fied. These attempts to Improve Instruction and Instructional processes, 
however, have served to spotlight evaluation weaknesses and indicate that 
most educational Improvement program^ are carried out on a trial and error 
basis. Without the ability to diagnose student capabilities and needs, 
without the ability to compare alternative programs, there exists little 
basis for directed Improvement. I 

In order that evaluation better serve the needs of education, evalua-j 
tion Itself m'ist become a more active part of the process 6f change and an 
Important activity in decision-making. Feedback for curriculum revision 
should come from evaluation. Curriculum! choices should be based upon data 
generated for evaluation. Hence, the evaluation needs of the education syi 
tern are more than the limited tests and ijieasurement skills usually offered. 
Evaluation must becpme more than the quidkly gathered "after-the-fact" data 
selected to justify a program. 



Thus an /valuation process 1n the educational setting Introduces 
conditions for the adoption of scientific methodology. Evaluation^ 
education should, moreover, be an on-go1ng process. Us purpose bein* 
to feed back toUntio* ** all Levant asoects of the educational pVocess 
m , continuous basis. Such an Information feedback system would serje 

„ abasis for directed change 'and provide a climate that facilitates, 

N, 

quality control 1n education. 

The design of the Evaluation Service Center for Occupational 
Education emphasizes development of a comparable state-wide data pool! 
, technical support component to process and analyze the data-, dissemination 
of feedback; p'rogra«.t1c research and eval uation of Instructional 
efforts to meet state-wide and local needs. 

Several unusual logistics problems are generated in the collection 
end control of state-wide Information within a system Which seeks 
.0 preserve local autonomy in administrative decisionmaking, in curriculum 
design and modification, and 1n school organization. The size of the 
™n.ge TO nt and development tasks dictates gradual implementation whUh 
■ncludes feasibility studies of the processes, evaluation of the total 
, ys tem from a smaller experimental system, training of the personnel in 
the development of objectives, the development of an adequate test battery, 
the design procedures for data collection, analysis and feedback, don- 
ation, and the training of personnel to produce the information and to 
utilize and interpret the results. 

The Evaluation Service Center must then be thought of as an information 
feedback and evaluation systen which seeks program improvement and edification 
rather than program condemnation. It is designed as , partnership endeavor 
be tween state agencies and local schools, serving as an evaluation instrument 
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which provides information on a state-wide basis and yet preserving local 

autonomy/In curriculum design. / 

Th^rogram evaluation has been de/lgned to provide feedback on the 
rt^^ of specific programs In achieving locally detenalned/selected 
i ojectlves. Two essential components of the product assessment constitute 

-.1* major aspects of this program evaluation: / 

1. the development of a file of behavioral objectives for 

each program \ t 

2. the development of a t^t file for each objective. : - 
Since the evaluation and mformakn feedback system depends upon 

content designation by each indl vidua Achoof. it 1s conceivable that each 
iC hool would desire and develop different behavioral objectives within 
„ch curriculum are,. Although this poss\l bill ty exists, totally different 
,. jec t< ves for each curri cul urn area do not seem probabl e ; however . a 
, 4r iety of objectives within each area must be anticipated In the design 

-)t tne testing process. 

^Anticipation of unique objectives and the variety of conditions 
■ ...h ^curse sequences and organization/staffing patters, administrative 
U-uctk etc.) existing In the LEAs demands flexibility and continuous 

■Vvcioprei-.t in the testing process. 

u Relieved that Objective Syntheils-a model of curriculum develop- 
«„t which seeks to Incorporate diversity-avoids the old fantasies about 
centralis. mechanized, and systematized Imposition of goals on local districts 
,nd ,t the same time provides a framework within which centralized, mechan- 
ized sy-, cematlc evaluation of goals can be undertaken. , 

,, e , y nthesis\rocess Is perceived as the buckle that fastens the two 
ma jor co^,,ts of the information feedback/evaluation system by Incorporating 
those behave; objectives with similar performances into one synthesized 
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whole, containing Form Changes (options) to allow for different levels of 
competency and different prerequisite materials and skills to be demon- 
strated and utilized 1n the accomplishment of a particular performance. 

Objective Synthesis tends to support Cronbach's and Stufflebeam's view 
•.hat "evaluation" consists of the collection and use of information to make 
decisions about an educational program. Thr practice of justifying programs 
through the testimonies of experts and through the sanction of accreditation 
: agencies have led educators to believe that these activities fulfill the 
evaluation needs of a program without ever questioning the kinds of effects 
:he program has on students or on staff . This piecemeal approach to the 
development of evaluation skills has generally been unsatisfactory. 

Moreover, confusion in regard to purposes and usefulness of evaluation 
h,s generated a lack of confidence In the ability to evaluate programs func 
: tonally. There are. of ten few attempts to analyze what standardized tests 
.«asurc. usually, evaluation procedures for Instructional programs take place 
,r.ly at the end of the program, too late to become part of the decision- 
making feedback process which should be an integral part of evaluation 

1„, uce of evaluation <n an after-the-fact manner robs evaluation of 
ts no,t potential benefits and places the evaluator 1n a role of having to pass 
•ud^ent upon a program which cannot be altered from the information produced. 

' Such a situation can be avoided, however, by applying evaluation as a 
feedback mechanism rather than a post hoc operation, thus allowing evaluation 
to offer directions for proaram modification and operation. 

Both the Evaluation Service Center for Occupratlonal-fdOcSTTon as 
we,, a, tnis publication, "Instruction Manual for the SYNOB Package." 
owe their ex.stence to the qenlus and tireless efforts of those who 
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conceptualized and developed the System: 

Dr. Jim C. Fortune 
Dr. William G. Conroy 

and to the enthusiastic support and participation of those LEAs 
who have been associated with the Center. 

, \ /The "Instruction Manual for the SYNOB Package" 1s offered by 
theNmembers of the staff at ESCOE to those educators Interested and 
cowled to the ideals of such an Information Feedback System. 
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INTRODUCTION 



This publication 1s intended to serve primarily as a User's Guide 
for those Facilitators and Instructors associated with ESCOE who seek 
to use and Implement the Synthesized Objective Package. Besides a short 
explanation of the Objective Synthesis Process, the Instruction Manual 
contain, replicas of feedback documents from ESCOE to the LEAs, and from 
the LEAs back to ESCOE, ajlong with instructions on how to use and Imple- 
ment the various sections 5 of the Package. 

The Synthesized Objective Package 1s not a fixed collection of docu- 
ments but rather a unique collection of objectlves-both raw and synthe- 
S 1z.d-put together by ESCOE for feedback to, and response from, each 
individual LEA participating In the project. / The, Printouts of Raw an d 
Saaglgd Objectives for different subgroups as well as the Raw and Syn< 
mi1rr| M,tr1ces form the first half of the synthesis feedback 

,oop. They co^unlcate to each LEA a textual and graphic representation 
of Its own contribution to. the total data bank, besides Indicating how 
ESCOE has incorporated their unique contributions Into the Information 
feedback evaluation system by the process of synthesis. .The second half . 
of the feedback loop will be completed when LEAs respond Individually to 
these synthesized, objectives by w,y of the SYNOB Selection Re porting Form 

,„d the BJ - Unit CoveraqP hy SVNOBS - ! FA Reporting Fort,. 

Although this Instruction Manual has been prepared with a view to 
serving the need, of LEAs that Intend to u,e and Implement the Synthesized 
Objective Package, it Is hoped that other, who are interested in the 
Objective- Synthesis Process and in the purpose and functions of the various 
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components of the Package will, also find the manual useful. 

A final word of appreciation to all those who have contributed to 
the preparation of the 'Instruction Manual : 

V 

To Kathy Paranya of the University of Massachusetts Computer 
Center for her Invaluable help and support 1n providing computer 
programs and printouts; 

To Walter Long, for his helpful suggestions and the Illustrations 
Included 1n the Package; 

, And to Dr. William Conroy, Mr. Alfred Rios, and the late Mr. Jesse 
0. Richardson for their constant, help and guidance— we are especially 
grateful . 
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THE 5 YN0B PACKAGE 
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SYNOB PACKAGE SECTION I: 
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Purpose ; : / 
The RaW Objective Matrix is a one-way 
feedback instrument from the Evaluation 
Service Center for Occupational 
Education (ESCOE) to the Local Education 
Agencies (LEAs). 



1. The Raw Objective Matrix communicates to each LEA individually the 
total number of raw objectives submitted to ESCOE by that particular 
school: i 



(a) in each Subgroup 

(b) in each Block within the Subgroups 

(c) in each Unit within the Blocks 

Note: A zero in a particular unit square indicates 
that the LEA did not submit any raw objectives in that 
unit. This does not necessarily imply that the LEA 
must submit objectives to fill that "gap," although 
it may choose to do so after reading the synthesized 
objectives which cover that block and unit. 



2, The Raw Objective Matrix for a particular subgroup, when used in 
conjunction with its respective Block and Unit Breakdown, which 
describe, blocks and units within a subgroup by names and code 



numbers, shows each LEA where its own contribution of behavioral 
objectives fits Into the ESCOE data bank. 

Note: A blank square(s) indicates end of units in 
that particular block. (See Block and Unit Break- 
downs, Item 3 of SYNOB Package) 



/* 
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R AW OBJECTIVE PRINTOUT 
SVNOB PACKAGE SECTION II: 

Th(? Raw Objective Printout is a collection of each LEA's own objectives, 
<^ted by subgroup and listed by blocks and units. For the user's conven- 
ience, special care has been taken to state the names and code numbers 
of LEAs, Subgroups, Blocks, and Units on the Printouj;. 

* single line drawn across the page is used to senate the units within 
a block and a double line indicates the start of the next block, ^n 
addition, all blocks begin on a new page. 
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THE SYNTHESIS PROCESS 



Purposes I ! 

The Synthesis process is one of the rlajor services performed by 
UCGt. me Synthesized Objective Printout (SYNOB PRINTOUT) is a feedback 
instrument from E-SCOE to the LEAs and' as such forms the first half of 
the synthesis feedback loop. " N 

The process of synthesizing objective^ involves three main steps: 

* • 

1. coding pf all objective;; in a particular subgroup- 
according to blocks and units \ 

X.. \ 

2. grouping 1 , objectives within a particular unit by 
similarity of performance 

i i • 

3. combining all objectives with similar performances 
into one synthesized objective which contains options— 
"Form Changes "--to cover the variations in Conditions, 
deqrees of completeness, and Extent that existed in 
the raw objectives. (For details, see SYNOB PRINTOUT-- 

Item 3, SYNOB Package j ) 



fHF SYNOB PACKAG E; A TWO-WAY FEEDBACK INSTRUMENT 

rne ot->?r half of the loop will be completed when LEAs respond individually 

i 

:o these Synthesized Objectives by wajy of the SYNOB SELECTION REPORTING 
;RM '.Iter V, SYNOB Package), and indicate via one BLOCK AMD UNIT COVERAGE 
• tPU'.NG rCP'l (Item VI, SYNOB Package^) what portion of their course (in 
terms o* blocks and units of instruction) still remains to be covered by 
additional synthesized objectives. 
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SYNOB MATRIX 

synob Package section hi: j 

Purpose : 

lhe Synthesized Objective Matrix Indexes by blocks and units the 
synthesized objectives within a subgroup. 

It provides a means of locating the synthesized objectives, by SYNOB 
TO nurher, that cover specific blocks and units. It 1s possible 
that ore synthesized objective may cover several blocks and units, 
in, which case that SYNOB ID number will appear 1n more than one 
square on* the SYNOB Matrix. 



Vblank square indicates that at present there are no synthesized 
;jt)ject!ves in that particular unit. 
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SYNOB PRINTOUT , 

SYNOB PACKAGE SECTJON IV: 

! 

Purpose : 

As stated previously, the Synthesized Objective Printout provides 
feedback from ESCOE to the LEAs. 

'Synthesized Objectives are listed in numerical sequence within a 
subgroup. Thus S 17 t5 02/001 1s the SYNOB ID number assigned to the 
first synthesized objective within the subgroup Electronics (17 15 02). 

The month and year that a Synthesized Objective was developed (8/71) 
appears on the same line as the SYNOB ID number in the Synthesized 
Objective Printout. 

immediately following this line 1s a listing of the blocks and units 
(by code number and name) that are touched upon by that particular 
synthesized objective. 

The I P numbers and the Levels of the Raw Objectives from which' the 
Synthesized Objective was created appear below the block and unit listing. 

"!i e Cc-yonrnt s of a Synthesized Objective : 

A Synthesized Objective contains three components: 

1*0 Conditions 
2*0 Performance 
3'0 Extent 

.-the >m*. basic components that form a Raw Objective. 

The Sy*t h ev's Process, however, yields components that consist of a 

-12- 



combination of fixed and variable text. The variable text is in the 
form of interchangeable parts and provides a means for the LEA to select 
its own unique method of utilizing the different components of that 
nynthes<!»d objective. ■ It is envisioned that the services of ESCOE 
become even more valuable to LEAs at this stage by opening up to them 
the options offered by other LEAs utilizing the same basic objective. 

Ihe Form Changes (options) are coded thus: 

1*0 Conditions 
2»0 Performance 
3*0 Extent ; 

Within the component Condition (1-0) the form change Ml indicates 
the first interchangeable part, the form change M2 indicates the 
second option within that particular interchangeable part, M3 indicates 
the third option, and so on. Form Change V21 indicates the first 
notion within the second interchangeable part, 1*22 the second option, 
?nd so on: 

1*0 Condition: 

(fixed text) 

[ 1 1*H 

£ -j ] # i2 (Variable Text) 

[ ] T13 • 

(fixed text) 

j- -j i *21 (Variable Text) 

[ ] 1*22 
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SYNOB SELECTION REPORTING FORM 
SYNOB PACKAGE SECTION V: 

> 

Purpose: \ 

The Synthesized Objective Selection Reporting Form completes the 
Synthesized Objective feedback loop, 1n that the LEAs are given an 
opportunity to respond to the synthesized objectives developed by 
ESCOE out of the raw objectives. 

The top of the form provides space for i>the LEA to fill in the required 
information about school, subgroup, level, and SYNOB ID number. Space 
is-atso provided under Conditions, Performance, and Extent for LEAs to 
indicate, by inserting the appropriate form change number, which form 
change (option) or group of form changes are used by them in each component 

Furthermore, the LEA may indicate the need for additional form changes 
within a component by adding the next highest form change number and, 
in the space provided, specifying the additional form change desired. 

There, 1s also space to make general comments on either the separate 
components or the whole synthesized objective. *For example: an LEA may 
disagree with a portion of the fixed text and ind.icate this in the place 
provided, by inserting its own version. 

It would also be helpful if— in the block of space provided fo- General 
Comments-each Instructor/Facilitator would indicate approximately how 
well (in percentages) this particular synthesized objective covers his/her 
course of instruction. 
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w nr.K AND UNIT COVERAGE 

r>v SYNOBS LEA ^^P ORTING FORM 

7 — % 

SYNOB PACKAGE. SECTION VI: 
Purpose/. 

The purpose of this reporting form Is to render a more meaningful feed- 
back from each LEA to ESCCE on the Synthesis Objectives developed by 
the Center. It is thus another step in completing the second half of 
the feedback loop. 

The Block and Unit Coverage by SYNOBS Reporting Form makes it possible 
for each LEA to respond to ESCOE's coverage of blocks and units of 
instruction within a particular subgroup, by the Synthesized Objectives . 
developed at the Evaluation Service Center. 

d L mentioned earlier, the SYNOB Matrix (SYNOB Package, Item .11) 
iovldes a means of locating Synthesized Objectives-by SYNOB 10 numbers- 
that "touch upon" specific blocks and units. 
' Now this Block and "nit Coverage by SYNOBS Reporting Form (SYNOB Package, 
lum IV) provides an opportunity for each LEA to indicate what portion of 
their course of instruction (by blocks and units) still remains to be 
covered by Synthesized Objectives. 

Thus a percentage figure in a particular square indicates what portion of 
this LEA's course (by blocks and units) hasjjot been covered by ESCOF 
Synthesized Objectives. 

A blank 1n a square Indicates that the LEA feels that the particular unit 
Of induction is adequately covered by ESCOE's Synthesized Objectives. 
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GLOSSARY OF TERMS AND PHRASES 



AFFECTIVE CAPABILITIES 



Positive or negative feelings toward an object, 
person, or idea. 



AFFECTIVE DOMAIN 



The sphere of learning that deals with feelings 
or attitudes. 



BATCH • 

f 

A set of four subgroups processed simultaneously. 

BEHAVIORAL OBJECTIVE 

A measure from which capabilities can be inferred, 
listing th'e exact performance to be demonstrated, 
the exact conditions under which the performance 
is carried out, and the exact extent (degree of 
completeness, accuracy, speed, etc.) to which 
the performance will be measured. 



BLOCK 



Largest instructional segment of a subgroup. 



CAPABILITY CLASSIFICATION 



A system for coding the abilities demonstrated by 
the performance of a behavioral objective as psycho- 
motor, cognitive, affective, or combinations thereof. 



CATEGORY BREAKDOWN 



The terms Field of Study, Major Group, Subgroup- 
which ESCOE ur.es to categorize occupational programs 
of study. 



CODING HEADER 

A tabular listing of data. 
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GLOSSARY (con't) 



COGNITIVE CAPABILITIES 

The ability to do. things that are mostly 
intellectual or mental in nature. In general, 
' cognitive capabilities involve acquiring and 
applying knowledge or information. 



COGNITIVE DOMAIN 

The sphere of learningwhich deals with developing 
intellectual or mental capabilities. 



CONDITIONS 

That portion of a behavioral objecttve which states 
' the exact circumstances under which the objective r 
is performed, including: instructions, raw 
materials, parts, tools, equipment, drawings, 
models , etc . 



CRITERION 

A standard of judgment. 



CRITERION- REFERENCED STANDARDS 

Scores are 'interpreted as to the amount of proficiency 
the individual exhibits in a subject'area. The 
score would describe how the student performed on 
specific objectives at a given point in his learning 
program. 



CRITERION TEST 

The evaluation instrument used to assess the degree 
'to which the performance of the student meets pre- 
determined performance objectives. 



DOMAINS ; 

Educational spheres of learning, *i.e., Affective, 
Cognitive, Psychomotor. 
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GLOSSARY (con't) 



ESCOE 

Evaluation Service Center for Occupational Education. 



EXTENT 



That portion of a behavioral objective which 
states the exact criteria used to measure the 
performance, including: tolerances, accuracy, 
quality or workmanship, speed, etc. 



FACILITATOR 

ESCOE liaison person in a local educational agency. 

FEEDBACK ^ 

The process of Amrniuni eating the products of the 
system to the users and the process by which the 
users react to the performance of the system. 

FEEDBACK CHECKLIST 

Form used by ESCOE to cornnunlcate responses/comments 
relative to objectives submitted by LEAs. 



FIE'.D OF STUDY 

The broadest category of occupational *™* 
. classification, i.e., Trade and Industry, Health 
Occupations, etc. 



FIXED TEXT 

The portion of a synthesized objective that is 
not optionabie. 

FORM CHANGES 

The options available within a synthesized objective. 
(The so-called variable text.) 

INPUT 

Material upon which the system operates and is developed. 
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GLOSSARY (con't) 

LEA 

,see Local Educational Agency 
LEARNING DOMAINS 



Spheres of educational influence, i.e., Affective, 
Cognitive, Psychomotor. 

LOCAL EDUCATIONAL AGENCY 

A school, i.e., high school., trade school, 
vocational -technical school, BOCES center, 
community college, junior college, skills center, etc, 



MAJOR GROUP 



MATRIX 



Cateaory breakdown .of occupational programs 
within a Field of Study, i.e., Health occupations: 
Dental Services, Medical Services, Nursing. 



A rectangular array of information displayed on 
a chart having horizontal and vertical coordinates. 



NORM-REFERENCED STANDARDS 



Traditional approach where students' performance 
is compared to the performance of others in the 
same reference group, such as achievement tests 
and aptitude tests.. These tests provide no direci 
indication of the individual's degree of proTTciency 
in the subject matter. 



OUTPUT 



The product of the system. 
PERFORMANCE 



That portion of a behavioral objective that states 
the exact observable behavior chat is required. 
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GLOSSARY (con't) 



PRINTOUT 



Printed computer output. 



PROCESS 

The ongoing state of the system while doing 
whatever has to be done in order to attain 
the purpose. 

PSYCHOMOTOR CAPABILITIES-/ 

• The ability to do things that are mostly 
muscular in nature, but which ensue from 
cognitive capabilities. In Seneral psycho- 
> . motor capabilities involve manipulating objects 
with various parts of the body. 

PSYCHOMOTOR DOMAIN 

The sphere of learning that deals with developing 
D hv«ical skills requiring muscular coordination 



phy< - 

and varying degrees of strength. 



RAWOB 



see Raw Objective 



RAtfOBJI CTIVt 

Behavioral Objrctivc written by the Local Education 
Agency. 

SUBGROUP 

/ Cateqory breakdown of occupation programs within 

a Maior Group, i.e., Dental Services: Dental . 
Assis?ant Dentai Laboratory Technician, Dental (other) 



SYNOB 



see Synthesized Objective, 



SYNTHFSIZr (dictionary) 



(1) To make up by combining parts or elements, 

(2) To combine into a complex whole. 
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GLOSSARY (con't) 



SYNTHESIZED OBJECTIVE 

A behavioral objective consisting of fixed and 
variable text, produced by combining raw objectives 
having the same or similar performances into one 
objective so that all variations of conditions 
and extent indicated by the LEAs are included. 



SYSTEM 

Entity designed by main which applies commonsense 
decision-making by uiing self-correcting and 
logical methodoloqy. J Includes identification of 
specific goals and objectives, the analysis of 
functions and components, the training and 
testing of the system, the installation and 
quality control . 



TERMINAL OBJECTIVE 

A desired outcome of an educational program. 

Infers' a capability Which is an essential, specific 
occupational competency. 

A capability that cannot be inferred from a higher 
order objective. 

TEST DEVELOPMENT 

The research process of creating, from standard 
instructional activities, measures of performance 
stated by each synthesized objective. The process 
includes placing these observed activities in a 
format so as to standardize their administration 
and scoring, and so that they may be requested and 
organized into a test packet tailbred to test the 
objectives taught in a given classroom. 



UNIT 

Instructional segments within a Block. 



U.S.O.E. 

United States Office of Education. 
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GLOSSARY (con't) 



ERIC 



U.S.O.C. Code 



United States Office of Education code numbers 
used to Identify trades, academic subjects, 
occupational areas, etc. 



Variable Text 



That portion of a synthesized objective which 
is optionable. (The Form Changes.) 
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